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1 Setting of the problem 

Our model is a one dimensional semilinear diffusion equation in a confined system, 
where interactions with extremal points cannot be disregarded. The extremal points 
have a mass and the boundary potential evolves with a specific dynamic. Stochas- 
ticity enters through fluctuations and random perturbations both in the inside as 
on the boundaries; in particular, in our model we assume that the control process 
is perturbed by a noisy term. 

There is a growing literature concerning such problems; we shall mention the 
paper [2] where a problem in a domain C 1" is concerned; the authors cite as an 
example an SPDE with stochastic perturbations which appears in connection with 
random fluctuations of the atmospheric pressure field. As opposite to ours, however, 
that paper is not concerned with control problems. Quite recently, the authors 
became aware of the paper [T] where a different application to some generalized 
Lamb model is proposed. 

The internal dynamic is described by a stochastic evolution problem in the unit 
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interval D = [0, 1] 

d t u(t, x) — d x u(t, x) + f(t, x, u(t, x)) + g(t, x, u(t, x))W(t, x) (1) 

which we write as an abstract evolution problem on the space L 2 (0, 1) 

du(t) = A m u(t) + F(t, u(t)) dt + G(t, u(t)) dW(t), (2) 

where the leading operator is A m — d x with domain D(A m ) = H 2 (0, 1). We assume 
that / and g are real valued mappings, defined on [0, T] x [0, 1] x R, which verify 
some boundedness and Lipschitz continuity assumptions. 

The boundary dynamic is governed by a finite dimensional system which follows 
a (ordinary two dimensional) stochastic differential equation 

d tVi {t) = -b lVl {t) + d v u{t,i) + hi{t)Vi(t), i = 0,1 

where bi are positive numbers and hi(t) are bounded, measurable functions; d v is 
the normal derivative on the boundary, and coincides with (— l) l d x for i = 0,1. For 
notational semplicity, we introduce the 2x2 diagonal matrices B = diag(— &— , fei) 
and h{t) = diag(/i (£), h\{t)). There is a constraint 



Lu = v 



which we interpret as the operator evaluating boundary conditions; the system is 
coupled by the presence, in the second equation, of a feedback term C that is an 
unbounded operator 

d x u(0) \ 



Cu 



The idea is to write the problem in abstract form for the vector u = [ I on 



the space X = i 2 (0, 1) xl 2 , that is 



v 



du = Au(i) + ¥{t, u(t)) dt + G(t, u(t)) > 

'u \ (3) 



11(0) 



Our main concern is to study spectral properties of the matrix operator 
on the domain 

D(A) = {u e D(A rn ) x R 2 : Lu = v}. 

Theorem 1. A is the infinitesimal generator of a strongly continuous, analytic 
semigroup of contractions e tA , self-adjoint and compact. 
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We shall prove the above theorem in Section [21 Further, we shall prove that 
A is a self-adjoint operator with compact resolvent, which implies that the gener- 
ated semigroup is Hilbcrt-Schmidt. Moreover, we can characterize the complete, 
orthonormal system of eigenfunctions associated to A. 

Let us fix a complete probability space (f2, £F, {£F t }, P); on this space we de- 
fine W(t), that is a space-time Wiener process taking values in X and V(t) = 
(Vi(t),V2(tj), that is a Revalued Wiener process, such that W(t,x) and V(t) arc 
independent. 

As a corollary to Theorem [TJ using standard results for infinite dimensional 
stochastic differential equations, compare [3j Theorem 7.4], we obtain the following 
existence result 

Theorem 2. For any initial condition [ U ° ] elxl 2 there exists a unique process 

\vqJ 

u e L 2 F (0, T; X x R 2 ) such that 

u(t) = e tA M + J e (t - s)A F(u(s)) ds + j e^ s ^> A G(u(s)) dW(s) 

that is by definition a mild solution of ([3]). 

The abstract semigroup setting we propose in this paper allows to obtain an 
optimal control synthesis for the above evolution problem with boundary control 
and noise. This means that we assume a boundary dynamics of the form: 

d t v(t) = bv(t) - d„u(t, •) + h(t)[z(t) + V(t)} (4) 

where z(t) is the control process and takes values in a given subset of M 2 . 

As before, we can write the system - defined by the internal evolution problem 
(fT]) and the dynamical boundary conditions described by ([JJ - in the following 
abstract form 

|du t 2 = Auf At + F(i, uf) df + G(t, v4)[Pzt dt + dW t ] 

\ut =U . 

P : M 2 — > X denote the immersion of the boundary space in the product space 
X = L 2 (0, 1) x R 2 . 

The aim is to choose a control process z, within a set of admissible controls, in 
such way to minimize a cost functional of the form 

J(i , uo, z)=E [ \{s, u z s ,z s j) ds + E(j)(u^) (6) 



where A and (j) are given real functions. In our setting, altough the control lives in a 
finite dimensional space, we obtain an abstract optimal control problem in infinite 
dimensions. Such type of problems has been exhaustively studied by Fuhrman and 
Tessitore in [S]. The control problem is understood in the usual weak sense (see [7])- 
We prove that if / and g are sufficiently regular then the abstract control problem, 
under suitable assumptions on A and <fi, can be solved and we can characterize 
optimal controls by a feedback law (see Theorem 1171 and compare Theorem 7.2 in 
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Theorem 3. In our assumptions, there exists an admissible control {z t , t € [0, T]} 
taking values in a bounded subset ofM 2 , such that the closed loop equation: 

du T = Au T dr + G(r, u t )PT(t, u t ,G(t, u t )*V x v(t, u t )) dr 

+ F(r,u r ) dr + G(r,u r ) dW T , t e [t ,T], (7) 

ut = u e X. 

admits a solution and the couple (z, u) is optimal for the control problem. 

Stochastic boundary value problems are already present in the literature, see the 
paper [TTj and the references therein; in those papers, the approach to the solution 
of the system is more similar to that in [2] . We also need to mention the paper [5] 
for a one dimensional case where the boundary values are set equal to a white noise 
mapping. 



2 Generation properties 

Let X = L 2 (0, 1) be the Hilbert space of square integrable real valued functions 
defined on D = [0, 1] and X = X x R 2 . In this section we consider the following 
initial-boundary value problem on the space X 



(8) 



' f t u{t) = A m u(t) 
v(t) = Lu(t) 
j- t v(t) = Bv(t) - Cu{t) 
[u(0) = u £X, v(0) = v a eR 2 . 

In the above equation, A m is an unbounded operator with maximal domain 

A m = d 2 x , D(A m )=H 2 (0,1); 

B is a diagonal matrix with negative entries (—60, —b±). 

Let C : D(C) C X -> dX the feedback operator, defined on D{C) = H 1 ^, 1) 

as 



Cu = 



d x u(0) 
-d x u(l) / 

The boundary evaluation operator L is the mapping L : X — > K 2 given by 



Lu = 



u(Q) 
u(l) 



Its inverse is the Dirichlet mapping D 



A,L 



D^ L <j> = u(x) e D(A m ) 



-» D{A m ) 

' '(XI -A m )u(x) 
Lu = 6. 



As proposed in [10], we define a mild solution of |[8} a function u G C([0, T]; X) 
such that 

f u(t) = uo + A„ J * u(«) ds, * G [0, T] 

\v(t) =v + B J* v(s) ds + C r 4 u (s) ds. 
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In order to use semigroup theory to study equation (j8]), we consider a matrix 
operator describing the evolution with feedback on the boundary 

on the domain 

D{A) = {ue D(A m ) x M 2 : Lu = v}. 

Then a mild solution for equation ([8|) exists if and only if A is the generator of a 
strongly continuous semigroup. 

The above definition of the domain D(A) puts in evidence the relation between 
the first and the second component of the vector u. There is a different characteri- 
zation that is sometimes useful in the applications. 

Let us define the operator A as A = A m on D(A ) = D(A m ) : Lu = 0}. 
We can then write the domain of A as 

D(A) = {u e D(A m ) x dX : u - D^ L v e D(A )}. 

The operator A can be decomposed as the product 

0\ (I -D A ^ 
B) \C 

Then, according to Engel [6], A is called a one-sided i^-coupled matrix- valued 
operator. 



Proof of Theorem [T] 

In this section we apply form theory in order to prove generation property of the 
operator A, compare the monograph [13] . 

Proposition 4. A is the infinitesimal generator of a strongly continuous, analytic 
semigroup of contractions, self-adjoint and compact. 

We will give the proof in two steps. First of all we will consider the following 
form: 

a(u,v)= / u'(x)v'(x)dx + b Q u(0)v(0) + b 1 u(l)v(l) 
Jo 

on the domain 

V = {u = (u,a) E ^(0,1) x R 2 | u(0) = a ,u(l) = ax] 

and we will show that it is densely defined, closed, positive, symmetric and continue. 
Moreover, the operator associated with the form a is (A, D(A)) defined above. 
According to [13], this implies that the operator A is self-adjoint and generates a 
contraction semigroup e tA on X that is analytic of angle \. Then we will show the 
self-adjointness and the compactness of the semigroup e tA . To see this, we will refer 
to 0. 

Let us begin with the properties of the form a. 
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Lemma 5. The form a is densely defined, closed, positive, symmetric and continue. 

Proof. By assumption, since bg and bi are positive real numbers, it follows that in 
particular a is symmetric and positive. 

It is clear that V is a linear subspace of X. Observe that V is dense in X if any 
u e X can be approximated with elements of V. Consider (u,a) e L 2 [0, 1] x R 2 . 
Since C^°[0, 1] is dense in L 2 (0,1) it follows that for all e > there exists v £ 
C C °°[0,1] such that 

\u-v\ L2[Q1] < -. 

Now let po(x) be a symmetric function in C^°(R) with support in B £ (Q), po(0) = 1 
and J R po(x) dx — e/3. Finally, let p\{x) = po(x-l). Then, if we define the function 

, we have: 



v + a a p a 



+ Oil Pi 

[04] 



[0,1] 



\ u - p\li[o,i] ^\ u ~ v \l?io,i] + l a oPo| L 2 [04] + |aiPi| L 2 [0;1] < 
< max{l,a ,ai}e- 

Morever, p(0) — an and p(l) = a\. Thus 

\(u,a)-(p,p(0),p(l))\ x <Ms 

for a suitable M. This shows that V is dense in X. 

In order to check closedness and continuity of a, observe first that the norm 
induced by a on the space V is equivalent to the norm given by the inner product 

(u,v)v= / [u'(x)v'(x)+u(x)v(x)]dx + u(l)v(l)+u(0)v(0). 
Jo 

In fact, if we set b = bo + &i, we have 



0(U,U) + \\ufy 



so that 

||u||^ < 2||u||^ 1(0jl) +26 [u(0) 2 +m(1) 2 ] < max{2,2fe}||u||^. 

Now observe that V becomes a Hilbert space when equipped with the inner product 
defined above since V is a closed subspace of -ff 1 (0, 1) x M 2 . Then a is closed. 
Finally, a is continuous. To see this, take u, v e V; then 

|a(u,v)| < [ \u'(x)v'(x)\ dx + 6[K0)|K0)| + Kl)|Kl)|] 
Jo 

< ll«ll ff i ( o,i) ll"ll^(o,i) +MI«(o)l |«(0)| + Ki)l \v(l)\] 
<||u|| v ||v|| v <M||u||J|v|| 

by the Cauchy-Schwartz inequality. □ 
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Lemma 6. The operator associated with a is (A,D(A)) defined above. 

Proof. Denote by (C, -D(C)) the operator associated with a. By definition, C is given 

by 

D(6) = {feV\3geX s.t. a(f , g) = (g, h) x Vh e V) 

ef = -g. 

Let us first show that A C 6. Take f e D(A). Then for all h e V 

o(f,h)= / f'(x)h'(x)dx + b f(0)h(0) + b 1 f(l)h(l) 
Jo 

= f'(x)h(x)\l- f f"(x)h(x)dx + b f(0)h(0) + hf(l)h(l) 
Jo 

= /'(l)ft(l) - /'(0)fc(0) - / f"{x)h(x) dx + bof(0)h(p) + hf(l)h(l). 

Jo 

At the same time, if we set a = (/(0), /(l)), ft = (h(0), h(l)), we have 

(Af , h) = (Af, h) L i ( o,i) + (Cf + Ba, /3) R 2 = 

= / f"(x)h(x)dx + f(0)h(0)-f'(l)h(l) 
Jo 

-b f(0)h(0)-hf(l)h(l) = -a(f,g). 

The last equality shows that A C 6. 

To check the converse inclusion 6 C A take f e D(C). By definition, there exists 
gel such that 

o(f,h) = (g,h) x , VheV 

that is, 

f f{x)h'{x)dx= [ g{x)h{x)dx. 
Jo Jo 

Now choose h = (h, a) e V such that the function h belongs to ^(0,1) (the 
existence of such a function is ensured by the continuous embedding of Hq(0, l)in 
i/ 1 (0, 1)). Then by the last equality we cand derive that /' e i/ 1 (0, 1) and g 
is the weak derivative of /': it follows that /' e H x (0, 1) and we conclude that 
/ £ H 2 (0, 1)- Integrating by parts as in the proof of the first inclusion we see that 

o(f,h)= / f(x)ti(x)dx + b f(0)h(0) + hf(l)h(l) 
Jo 

= f'(x)h(x)\l - f f"(x)h(x)dx + b f(0)h(0) + hf(l)h(l) 
Jo 

= (-Af,h) = (g,h), VheV. 

This implies that Af = — g, and the proof is complete. □ 
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Corollary 7. The operator (A, 13(A)) is self-adjoint and dissipative. Moreover it 
has compact resolvent. 

Proof. The self-adjointness of A follows by [13] (Proposition 1.24) and he dissipativ- 
ity is obsvious. Since D(A) C H 2 (0, 1) x R 2 , the operator A has compact resolvent 
and the claim follows. □ 

Taking into account the above corollary, it follows that A generates a contraction 
semigroup (e tA )i>o on X that is analytic of angle ir/2 and self-adjoint. Finally, by 
[9l Corollary XIX. 6. 3] we obtain that e* A is compact for all t > 0. 

Thus we have just proved Proposition |4] 
Remark 1. By the Spectral Theorem JP1 Chapter XIX, Corollary 6.3] it follows 
that there exists an orthonormal basis {e„} ngN o/X and a sequence {A n } ngN of real 
negative numbers X n < 7 such that e n £ D(A), Ae n — A„e„ and lim A n = — oo. 

n — * oo 

Moreover, A is given by 



Au = ^ A„(u, e„)e„, u e D(A) 



n=l 

and 

oo 

c iA u = ^2 e A "*(u, e„)e„, u e X. 
n=l 

2.1 Spectral properties of the matrix operator 

We shall now apply Theorem 2.5 in Engel 6 in order to describe the spectrum of 
A. According to that result 

cr(A) C a(A ) U a{B) U S (9) 

where 

5={Ae p(A ) n p(B) : Det(F(A)) = 0}. (10) 
The matrix F(X) is defined as 

F(X)=I-(X-B)L X K X R(X,B) 

where the operators L\ and K\ are given by 

L\ = -BR(X, B)R(0, B)C, K x = -A R(X, A )D^ L . 

Notice that the matrix F(X) can also be written as 

F(X) =1 + CA a R(X, A )D$' L R(X, B). 

Remark 2. In case when the feedback operator matrix C is identically zero, the 
above construction implies that S = 0. 
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Determining the set S 

In the following, we construct explicitly the set S. The idea is to construct the 
matrix F(X) and compute its determinant. 

We have to distinguish two cases. If A < we have 

„ , /,%% / — r cos(V— A) / 1 1 \ A 

Det(F(A)) = 1 + vv ; ' 1 ' 1 



in(V^A) \X + bo X + bi) (A + 6 )(A + fei) 

We note that the equation Det(F(A)) = has infinite solutions {Ajj^gN and 
every Xj belongs to the interval (— 7r 2 (j + l) 2 ,— 7r 2 j 2 ). 

Each Xj is eigenvalue of the operator A corresponding to the eigenfunction <pj = 
(e j (x),e j (Q),e j (l)) where 



6j (x) — ^— — cos \J—\jX + Bj sin y/—\jx. 

bo + Xj 



for a normalizing constant < £>, < + ^ 
If A > then 



Det(F(A)) = 1 + VA- 



e 2V^ 



(_l + e 2 7A) \b + X h + XJ (b + A) (6i + A) ' 

We note that Det(F(A)) > for every A > 0. This means that there are not 
elements A strictly positive in S. Moreover the eigenvalues of A in S are all negative. 

Remark 3. It is possible to verify directly with some computation that the eigen- 
values of A are not eigenvalues of A. 

Further, the same happens in general with the eigenvalues of B, except in case 
bo and b\ satisfy an explicit relation. In any case, also if bo and b\ happen to belong 
to a (A), they are in a finite number and do not affect its behaviour. 

Therefore, with no loss of generality, in the following we may and do assume 
that all the eigenvalues of A are contained in S. 

Theorem 8. In the above assumptions the semigroup e tA is Hilbert- Schmidt, that 
is, 

oo 

5> tA< ^iW)x R 2 <°° ( n ) 

i=l 

for any orthonormal basis {4>{\ of L 2 (0, 1) x R 2 . 

Proof. In order to prove that the semigroup e tA is Hilbert-Schmidt, it is enough 
verify the (fTTj) for an orthonormal basis. Let {&} the orthonormal sequence of 
eigenfunctions of the operator A described in Remark [T] Then 



»=i 
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where Xi are the eigenvalues of the operator A. By ((9]) it follows that 



5> 2tA *< J2 e2tA, + E e2tx '+ E <~ 



i=l i:\ieo(A) i:\iecr(B) i: \i<=S 

But, by Remark [3] we have that 



^e 2tA -< ]T e2tAl + E 

i=l i:Aiecr(B) i:\iGS 



e 2tX t 



and the first of the last two series is a finite sum and the second one converges since 
the eigenvalues Xi in 5* are asymptotic to — ir 2 i 2 . 

□ 

3 The abstract problem 

In this section we are concerned with problem ([3]) : we introduce the relevant assump- 
tions and we formulate the main existence and uniqueness result for its solution. 

Let W = (W, V) be the Wiener process taking values in = L 2 (0, 1 ) x M 2 . We 
denote {?t, t £ [0, T]} the natural filtration of W, augmented with the family N 
of P-null sets of 5" T : 

? t = a(W(s) : s£ [0,i])vN. 
The filtration satisfies the usual conditions. 
Define F : [0, T] x X -> X for every u=fjel 

where F(t,u)(£) = /(U, «(£))• 

Let G be the mapping [0, T]xl^ L(X, X) such that, for u = [ " ] and y = ^ ' 
in X, 



vJJ \J]J \G 2 {t,v)rj 
where 

(Gi(t,u)y)(0=g(t,Z,u(0)y(0 and (G 2 (t, v) ■ r{) = h(t) m 

we stress that h is a diagonal matrix. 

Therefore, we are concerned with the following abstract problem 

Jdu t = Au t dt + F(t, u t ) dt + G(t, u,)dW, 
\u to = u 

on which we formulate the following assumptions. 



(12) 



Control of stochastic differential equations with dynamical boundary conditions 



11 



Assumption 9. 

(i) f : [0,T] x[0.1]xl-> BL is a measurable mapping, bounded and Lipschitz 
continuous in the last component 

\f(t,x,u)\ <K, \f(t,x,u) - f(t,x,v)\ < L\u- v\. 

for every t £ [0,T], x £ [0, 1], u,v G E. 

(ii) g : [0, T] x [0,l]xl-> R, is a measurable mapping such that 

\g(t,x,u)\ < K, \g(t,x,u) - g(t,x,v)\ < L\u-v\ 

for every t £ [0,T], x G [0, 1], u, v G R. 

(mj /i : [0, T] — > M(2, 2) is a bounded measurable mapping verifying \h(t)\ < K for 
every t £ [0, T] . 

The existence and uniqueness of the solution to ()12|) is a standard result in the 
literature, see for instance the monograph [3 . In order to apply the known results, 
we shall verify that the nonlinear coefficients F and G satisfy suitable Lipschitz 
continuous conditions. That will be enough to prove the existence of a mild solution 
which is a process u t adapted to the filtration J t satisfying the following integral 
equation 

u t = e tA u + f e(*-^ A F(s,u s )ds+ f e ( *- s)A G(s, u fl ) dWs. (13) 
Jo Jo 

Proposition 10. Under Assumptions\9(i)-(iii) ; the following hold: 

1. the mapping F : X — > X is measurable and satisfies, for some constant L > 0. 

|F(t,u)-F(*,v)| x <i|u-v|i u,veX. 

2. <& is a mapping [0,T] xl-> L(X) such that 

a. for every v G X the map G(-, -)v : [0,T] x X — > X is measurable, 

b. e sA G(t,u) £ L 2 (T) for every s > 0, t £ [0,T] and u G X, and 

c. for every s > 0, t £ [0, T] and u.v £ X we have 

le^u^^Ls-^l + lulx), (14) 

|e sA G(i,u)- e sA G(t,v)| L2(x) <L S - 1 /4| u _ v | Xj (15) 

|G(t,u)U (X )<L(H-|u|x), (16) 
for a constant L > 0. 

Proof. 1. We have, for u = | U ) and v = ( W 

|F(t,u) -F(t,v)| x = |F(i, u )-F(t,w)| x < L|u-«| x < £|u- v| x . 
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2. Condition (fT6|) follows from the definition of G and the Assumptions [9] (ii)-(iii) 
on g and h. 

Now we prove condition (|14p . Let {0fc}fcgN be an orthonormal basis in X. 
Then 

\e sA G(t,u)\l 2{X) =J2\< e sA G(t,n)^,d> k > | 2 X 
= ^|<G(i,u)^-,e sA ^>| 2 x 
< |G(t,u)|| (X) |e sA H 2(x) <L 2 (l + |u| 2 x )|e sA || 2(x) . 

Using Theorem HI 

oo ^ 



sA|2 ^ \ „-2sn 

i 2 (X) 



where /(i) « means that f(s)/g(s) = 0(1) as s — > 0; this verifies 

In order to prove the last statement (|15p. we take the orthonormal basis 
{0fe}fceN consisting of eigenvectors of A (see Remark [TJ. We recall that 4>t — 
(e fc (a;),efc(0),efc(l)) where 



e fe (x) = £ fc r ^ - cos V^^fc^ + #fc sin \J-^kX- 

We have 

|e sA G(i,u) -e sA G(^v)|i 2(x) = ]T | < e* A [G(t, u) - G(t, v)]&, fc > | x 
But, for u = ( and v = ( j , by the definition of the operator G, we have 



|G(t,u)-G(t,v)0 fc |i= / | 5 (t,a;,u(a;))-s(t,a:,t>(a;))| 2 |ei t (i)|' , da; 

< / isT 2 |u(x) - w(a;)| 2 da; < £T 2 |u- v 
Jo 



since the function g is Lipschitz and |e/s(ir)| < Bk is uniformly bounded in fc. 
Consequently 

|e sA G(t, u) - e sA G(t, v)| L2(x) < {]T e 2tX "}^K\u - v| x 

fe 

< |e sA | i2( x)^|u-v| x 

which concludes the proof. 

□ 



Control of stochastic differential equations with dynamical boundary conditions 



13 



Proposition 11. Under the assumptions for every p € [2, oo) there exists a 
unique process u £ L P (S1; C([0, T]; X)) solution of \12\) . 

Proof. We can apply Theorem 5.3.1 in [4]. In fact by Proposition [4] the operator 
A generates a strongly continuous semigroup {e tA } of bounded linear operators in 
the Hilbert space X. Moreover, for this theorem to apply we need to verify that 
coefficients F and G satisfy conditions (fT4")) — (fT1)|) , which follows from Proposition 
M □ 



4 Stochastic control problem 

After some preliminaries, in this section we are concerned with an abstract control 
problem in infinite dimensions. We settle the problem in the framework of weak 
control problems (see [?])■ 

We aim to control the evolution of the system by the boundary. This means 
that we assume a boundary dynamic of the form: 

d t v(t) = bv(t) - d v u(t, •) + h(t)[z(t) + V(t)} (17) 

where z(t) is the control process. We require that z £ L 2 (S1 x [0, T];R 2 ). 

As in the previous section we can write the system 

d t u(t, x) — d%u(t, x) + f(t, x, u(t, x)) + g(t, x, u(t, x))W(t, x) 
d t v{t) = bv{t) - d v u{t, ■) + h{t)[z{t) + V(t)} ' ' M 

in the following abstract form 

duf = Auf dt + W(t,-u%)dt + G(t,u%)[Pztdt + dW t ] u to = u (19) 

where P : R 2 — > X is the immersion of the boundary space in the product space 
X = X x R 2 . Equation (fT9| , in the framework of stochastic optimal control problem, 
is called the controlled state equation associated to an admissible control system. 
We recall that, in general, fixed to > and uq € X, an admissible control system 
(a.c.s) is given by (SI, 1, {Jtjt^o, F, {W t } t > , z) where 

• (SI,?, F) is a probability space, 

• {F t }t>o is a filtration in it, satisfying the usual conditions, 

• {W f } t > is a Wiener process with values in X and adapted to the filtration 
{5t}t>o> 

• z is a process with values in a space K, predictable with respect to the fil- 
tration {S^tjt^o and satisfies the constraint: z(t) £ Z, F-a.s., for almost every 
t £ [to, T], where Z is a suitable domain of K. 
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In our case the space K coincide with M 2 . 

To each a.c.s. we associate the mild solution u z of state equation the mild so- 
lution u 2 6 C([to, T]; L 2 (Q; X)) of the state equation. We introduce the functional 
cost 

J(t ,u Q ,z) = E / A(s,u 2 ,z s ))ds + E0(u z .) (20) 

We consider the problem of minimizing the functional J over all admissible 
control systems (which is known in the literature as the weak formulation of the 
control problem); any a.c.s. that minimize J -if it exsts- is called optimal for the 
control problem. 

We define in classical way the Hamiltonian function relative to the above problem 

i/):[0,T]xlxl^M 

setting 

ip(t,u,w) = inf{A(t,u, z)+ < w,Fz >} (21) 

and we define he following set 

r(i, u,w)={zeZ: A(i, u. z)+ < w, Pz >= xf)(t, u, z)} 

We consider the Hamilton-Jacobi-Bellman equation associated to the control 
problem 

t G [0,T], xeX, ( 22 ) 

v(T,x) = $(x). 
where the operator L t is defined by 

£>t[<f>](%) = ^ Trace (G(t, x)G{x)*X7 2 (t)(x)) + < Ax.y^x) > . 

Under suitable assumptions, if we let v denote the unique solution of (|22[) then we 
have J(t, x, z) > v(t, x) and the equality holds if and only if the following feedback 
law is verified by z and u 2 : 

Thus, we can characterize optimal controls by a feedback law. 

This class of stochastic control problems, in infinite dimensional setting, has 
been studied by Fuhrman and Tessitore [8] (We refer to Theorem 7.2 in that paper 
for precise statements and additional results). 

In order to characterize optimal controls by a feedback law we have to require 
that the abstract operators F and G satisfy further regularity conditions. 

We will prove that, under suitable assumptions on the functions / and g in the 
problem (fT8|) . the abstract operators fit the required conditions. 
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We impose that the operators F and G are Gateaux differentiable. This notion 
of differentiability is weaker than the differentiability in the Frechet sense. 

We recall that for a mapping F : X — > V, where X and V denote Banach spaces, 
the directional derivative at point x € X in the direction h G X is defined as 

s^O S 

whenever the limit exists in the topology of V. F is called Gateaux differentiable 
at point x if it has directional derivative in every direction at point x and there 
exists an element of L(X,V), denoted VF(x) and called Gateaux derivative, such 
that VF(x; h) = VF(x)h for every he X. 

Definition 12. We say that a mapping F : X — > V belongs to the class S X (X; V) 
if it is continuous, Gateaux differentiable on X, and VF : X — > L(X, V) is strongly 
continuous. 

The last requirement of the definition means that for every h G X the map 
VF(-)h : X — > V is continuous. Note that VF : X — » L(X, V) is not continuous 
in general if L{X, V) is endowed with the norm operator topology; clearly, if this 
happens then F is Frechet differentiable on X . Membership of a map in ^(X, V) 
may be conveniently checked as shown in the following lemma. 
Lemma 13. A map F : X — > V belongs to S 1 (X, V) provided the following condi- 
tions hold: 

i) the directional derivatives VF(s; h) exist at every point x £ X and in every 
direction h G X ; 

ii) for every h, the mapping \JF(-]h) : X — > V is continuous; 

Hi) for every x, the mapping h t— > VF(x; h) is continuous from X to V . 

When F depends on additional arguments, the previous definitions and proper- 
ties have obvious generalizations. 

The following assumptions are necessary in order to provide Gateaux differen- 
tiability for the coefficients of the abstract formulation. 

Assumption 14. For a. a. t £ [0, T], £ G [0, f] the functions f(t,£,-) and g(t,£,-) 
belong to the class C (M). 

Proposition 15. Under assumptions^ and \ H\ for every s > 0, t G [0,T], 

F(t, •) G S^X, X), e sA G(t, •) G S^X, L 2 (X)). 

Proof. The first statement is an immediate consequence of the fact that f(t,£, •) G 
C 1 (K,R). In order to prove that e sA G(t, •) belongs to the class S 1 (X, L,2(X)) we use 
the continuous differentiability of g and an argument similar to that used in the 
proof of Proposition [TOl 

We note that, for u = and v = ^\ , the gradient operator V u (e sA G(t, u)) v 

is an Hilbert Schmidt operator that maps 

«A b sa fg u (t,.,u(-)M-H-)\ eS A (Vu (G(t,u)v)(w)) 
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lim 



In fact, we have 

u + rv) - e sA G(t, u) 



Ve sA G(i, u)v 



L 2 (X) 



lim > 



3,* 



lim > 
lim > i 



< 



< 



e sA G(t, u + rv) - e sA G(i, u) 



h-e sA (V„(G(t,u)v)<^),<^ > 



G(t,u + rv) -G(t,u) 



-V.Gfi.ujv U,,^ > 



,2sA fc 



G(i, u + rv) - G(i, u) 



V„G(i,u)v 



= limVe M ' t 
< c lim > 

c lim > e 

r-»o ' 
ft 



ff(t,u(0+r«(0)-ff(*,«(0) 



e fc (0-Su(t,«(0)«(Ocfc(0 



2aA* 



ff(t,«(0+";(0)-s(*»«(0) 



+ cm;(£)) - «(£))] dau(f) 



and, by dominated convergence, this limit is equal to zero. In similar way we can 
prove the points (ii) — (Hi) of Lemma IT3l to obtain the thesis. □ 

In order to prove the main result of this section we require the following hypoth- 
esis. 

Assumption 16. 

(i) A is measurable and for a.e. t G [0, T], for all u, u' G X, z G Z 
|A(f, u, z) - X(t, u', z)\<C\l + u+u'\ m \u-u'\ 
\X(t,0,z)\<C 

for suitable C G R + . m G N; 
(ii) Z is a Borel and bounded subset ofM 2 ; 

(Hi) $ G SHCt.K) and, for every a G [0,T], ip(a,;-) G 9 M ( X * X,R); 
(iv) for every t G [0, T], u, w, h G X 

|V u ^(t,u,w)h| + |V u 0(u)h| < L|h|(l + \u\) m ; 

(v) for all t G [0, T], for all u G X and w G X there exists a unique T(t, u, w) G Z 
that realizes the minimum in h21\) . Namely 



\{t, u, r(i, u, w))+ < w, PT(t, u, w) >= ip(t, u, w) 
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Theorem 17. Suppose that assumptions^ [7^| and \TB\ hold. For all a.c.s. we have 
J(to,uo, z) > v(to,Uo) and the equality holds if and only if the following feedback 
law is verified by z and u z ; 

Z (<r)=r(ffX.G(£r,u£)*VXoX))> P-a.s. for a.a. a e [t ,T]. (23) 

Finally there exists at least an a.c.s. for which f23\) holds. In such a system the 
closed loop equation: 

du T = Au T dr + G(t, u T )?r(r, u T , G(r, u t )*V x v(t, u t )) dr 

+ F(r,u T ) dr + G(r,u T ) dW T , re [to,? 1 ], (24) 

admits a solution and if~z(a) — T(cr, u ff , G{a,u. cr )*'SI x v{a, u ff )) fften i/ie couple (z, u) 
is optimal for the control problem. 

Proof. By Proposition[4]we know that A generates a strongly continuous semigroup 
of linear operators e* A on X. The assumption [9] ensures that the statements in 
Proposition [10] hold. Moreover the assumption [14] guarantees that the results in 
Proposition [T5l are true. Finally these conditions together with the assumption \W\ 
allow us to apply Theorem 7.2 in [S] and to perform the synthesis of the optimal 
control. □ 
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